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Abstract — Recovering sparse vectors and low-rank matrices 
from noisy linear measurements has been the focus of much 
recent research. Various reconstruction algorithms have been 
studied, including £i and nuclear norm minimization as well 
as £p minimization with p < 1. These algorithms are known 
to succeed if certain conditions on the measurement map are 
satisfied. Proofs for the recovery of matrices have so far been 
much more involved than in the vector case. 

In this paper, we show how several classes of recovery condi- 
tions can be extended from vectors to matrices in a simple and 
transparent way, leading to the best known restricted isometry 
and nullspace conditions for matrix recovery. Our results rely 
on the ability to "vectorize" matrices through the use of a key 
singular value inequality. 

Index Terms — rank minimization, sparse recovery 

L Introduction 

Recovering sparse vectors and low-rank matrices from noisy 
linear measurements, with applications in compressed sensing 
and machine learning, has been the focus of much recent re- 
search. The Restricted Isometry Property (RIP) was introduced 
by Candes and Tao in flS], ||3| and has played a major role 
in proving recoverability of sparse signals from compressed 
measurements. The first recovery algorithm that was analyzed 
using RIP was £i minimization in IS], lEl- Since then, many 
algorithms including GraDes [16], Reweighed £i E4\ . and 
CoSaMP [251 have been analyzed using RIP. Analogous to 
the vector case, RIP has also been used in the analysis of 
algorithms for low rank matrix recovery, for example Nuclear 
Norm Minimization |27|, SVP |21|, Reweighted Trace Min- 
imization 1 23 1 and AdMiRA |20|. Other recovery conditions 
have also been proposed for recovery of both sparse vectors 
and low-rank matrices including the Null Space Property [.30J , 
||26| and the Spherical Section Property ll30l . llT2l (also known 
as the 'almost Euclidean' property) for the nullspace. The 
first matrix RIP result was given in [i27il where it was shown 
that the RIP is sufficient for low rank recovery using nuclear 
norm minimization, and that it holds with high probability as 
long as number of measurements are sufficiently large. This 
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analysis was improved in f4\ to require a minimal order of 
measurements. Recently, [23] improved the RIP constants with 
a stronger analysis similar to |[T]. 

In this paper, we show that if a set of conditions are 
sufficient for the robust recovery of sparse vectors with sparsity 
at most k, then the "extension" (defined later) of the same set 
of conditions are sufficient for the robust recovery of low rank 
matrices up to rank k. 

While the recovery analysis in [23J and [j4J (Theorem 2.4) 
is complicated and lengthy, our results (see "Main Theorem") 
are easily derived due to the use of a key singular value 
inequality (Lemma [U. Our results also apply to generic 
recovery conditions, one of which is RIP As an example, 
Sk < 0.307 [IJ, S2k < 0.472 12 are two of the many RIP- 
based conditions (see also |I3|, lITS I) that are known to be 
sufficient for sparse vector recovery using £i minimization. 
A simple consequence of this paper is the following: The 
RIP conditions Sk < 0.307, < 0.472 (and all other RIP 
conditions that are sufficient for sparse vector recovery) are 
also sufficient for robust recovery of matrices with rank at 
most k improving the previous best condition of S2k < 0.307 
in ll23l . Improving the RIP conditions is a direct consequence 
of our observation but is not the focus of this paper, although 
such improvements have been of independent interest (e.g., 

m, mi 

Our results also apply to another recovery condition known 
as the Nullspace Spherical Section Property (SSP) and it easily 
follows from our main theorem that the spherical section 
constant A > 4fc is sufficient for the recovery of matrices 
up to rank k as in the vector case il30l . This approach 
not only simplifies the analysis in ||T2l, but also gives a 
better condition (as compared to A > 6fc in [12|). Our 
final contribution is to give nullspace based conditions for 
recovery of low-rank matrices using Schatten-p quasi-norm 
minimization, which is analogous to £p minimization with 
< p < 1 for vectors. These nonconvex surrogate functions 
have motivated algorithms such as IRLS ||22|- ifTOI that are 
empirically observed to improve on the recovery performance 
of £i and nuclear norm minimization. 



II. Basic Definitions and Notation 



of a matrix A is the smallest constant 5k for which 



For a vector x e M", || • ||o denotes its cardinality or the 
number of nonzero elements, x denotes the vector obtained 
by decreasingly sorting the absolute values of the entries of 
X, and x'^ denotes the vector obtained by restricting x to its k 
largest elements (in absolute value). Let diag(-) : M"^" — R" 
return the vector of diagonal entries of a matrix, and diag( ) : 
R" — > R"^" return a diagonal matrix with the entries of the 
input vector on the diagonal. Let ni < n2- We denote rank 
of a matrix X G R"i^"2 rank(X), and its ith largest 
singular value by a^{X). Let = [(Ti{X), . . .,an,{X)f 

be vector of decreasingly sorted singular values of X. X^ 
denotes the matrix obtained by taking the first k terms in the 
singular value decomposition of X. The nuclear norm of X is 
denoted by \\X\\i, = Yli'i=i '^ii^)^ ^^'^ its Frobenius norm by 
II^IIf = VEl^r^fW- Let = diag(S](X)) e R«^><"^ 
We call (t/, V) a unitary pair if U'^U = UU'^ = V'^V = I. 
In this paper, we'll use the following singular value decom- 
position of X: X — UYixV^ where {U,V) is a unitary 
pair Cleai-ly U G R"i><"i,T/ e R"2x«i. Notice that the 
set of matrices UDV'^, where D is diagonal, form an ni 
dimensional subspace. Denote this space by S{U,V). Let 



(i-4)||x||^<Px||2<(i + 4)||x|| 



(3) 



be a linear operator Ajj.vi') 



R™ is called the restriction of A to unitary pair ([/, V) if 
we have Au,v{-x.) ^ A{Udiag{-x.)V'^) for all x e M."K In 
particular, Au,v{-) can be represented by a matrix Auy. 

Consider the problem of recovering the desired vector 
Xq € M" with ||xo||i — k from corrupted measurements 
y = j4xo + z, with ||z||2 < e where e denotes the noise 
level, and A E M™^" denotes the measurement matrix. Under 
certain conditions, xg can be found under certain conditions 
by solving the following convex problem. 



mmimize ||x||i 

subject to ||Ax — yj|2 < e, 



(1) 



where recovery is known to be robust to noise as well as 
imperfect sparsity. We say x* is as good as xq w.r.t y if 
||ylx*— y||2 < eand||x*||i < ||xo|| i. In particular, the optimal 
solution of the problem [T] is as good as xq. 

Similarly, consider the case where the desired signal to be 
recovered is a low -rank matrix denoted by Xq £ R"i ^"2, with 
n = ni < 712. Let : R"!''"^ ^ R™ be the measurement 
operator We observe corrupted measurements y = A{Xa) + z 
with llzlU < e. 



mmimize 
subject to 



\A{X)-y\\2<e. 



(2) 



Similar to the vector case, we say that X* is as good as 
Xo w.r.t y if \\A{X*) - y||2 < e and \\X*\\^ < \\Xo\\^. In 
particular the optimal solution to problem^is as good as Xq. 
We now give the definitions for certain recovery conditions on 
the measurement map, the Restricted Isometry Property and 
the Spherical Section Property. 

Definition: Restricted Isometry Constant (RIC). The RIC 



holds for all vectors x with ||x||o < k. 

The RIC for linear operators, A : R"!^"^ ^ jr™ defined 
similarly, with X instead o/x, A instead of A and rank(X) < 
k instead of ||x||o < k, and \\X\\f instead of ||x||2. 

Definition: Restricted Ortliogonality Constant (ROC). The 

ROC of a matrix A is the smallest constant 9k,k' for which 



(Ax,Ax')| <0fe.fc'||x||2||x'||2 



(4) 



holds for all vectors x, x' with disjoint supports and ||x||o < k 
and ||x'||o < k'. 

Our definition of ROC for linear operators, A : R"!^"^ _^ 
R™ is slightly looser than the one given in 1123V . For a linear 
operator A, ROC is the smallest constant 9k.k' for which 



{A{X),A{X'))\<0k,k'\\X\\F\\X'\ 



(5) 



holds for all matrices X,X' such that rank(X) < k, 
rank(X)' < k' and both column and row spaces of X, X' 
are orthogonal, i.e., in a suitable basis we can write X — 







and X' 





X22 



We say that the matrix A (or operator A) satisfies RIP if the 
corresponding RIC and ROC constants are sufficiently small to 
ensure recovery of sparse vectors (low rank matrices). As one 
example if a matrix A satisfies 5k < 0.307 or 52k < 0.472, 
then we say A satisfies RIP, since these conditions are suffi- 
cient for recovery of fc-sparse vectors using £1 minimization. 

Definition: Splierical Section Property (SSP). The Spherical 
Section constant of a linear operator A : R"!^"^ j^m [g 
defined as 

and we say A satisfies the A-Spherical Section Property if 
A{A) > A. 

The definition of SSP for a matrix A E for analyzing 

recovery of sparse vectors is analogous to the above definition. 
Another way to describe this property is to note that a large 
A implies the nullspace is an almost Euclidean subspace |[30ll , 
whose elements cannot have a small ratio of £1 (nuclear norm) 
to £2 (Frobenius norm), and therefore the subspace cannot 
include sparse (low-rank) elements. 

In the subsequent sections, we give our main results relating 
vector recovery to matrix recovery. 

III. Key Observations 

Throughout this note, many of the proofs involving matrices 
apply the following useful Lemma which enables us to "vec- 
torize" matrices when dealing with matrix norm inequalities. 



Lemma 1. ( /[Wj ) (Key Lemma) For any X,Y e R"l^"^ 

we have 

J2W^iX)-T^iY)\<\\X-Y\U. (6) 
i=l 

We now give an application of Lemma [T| 

Lemma 2. Given W with singular value decomposition 
UT.wV^, if there is an Xq for which \\Xq + < H-'^oll* 
then there exists Xi G S{U, V) with E^i = '^Xa such 
that \\Xi -\- W\\i, < In particular this is true for 

X, = -UEx^V^. 

Proof: From Lemma [T] we have 

\\Xo + W\U>Y,\^^iXo)-^^{W)\. (7) 

i 

On the other hand, for Xi = -UY.XoV'^, W we have 

\\Xi+W\U - II-Sxo+SmHU = J2 \<^^iXo)-^^{W)\. (8) 

i 

Then from (|7J and ^ it follows 

11^1 + w\u < \\Xo + w\u < \\Xo\U = ll^ilU- (9) 

■ 

Although Lemma |2] is easy to show, it proves helpful in 
Theorem 1 to connect vector recovery (on restricted subpaces 
S{U, V)) to matrix recovery over all space M"!^"^. 

To further illustrate the similarity between sparse and low 
rank recovery, we state the null space conditions for noiseless 
recovery. 

Lemma 3. fi[2l/, BW ) Null space condition for sparse 
recovery 

Let A S R™^" be a measurement matrix. Assume e — then 
one can perfectly recover all vectors Xq with ||xo||o < k via 
program Q] ;/ and only if for any w S J^iA) we have 

k n 

^w,< Wi, (10) 

i=l i=k+l 

where Wi is the ith entry ofyv defined previously in section \n\ 

The use of the above condition has a long history; it was 
stated in ifTTI (see also ifTSl . lfT4ll ) for matrices made from 
concatenation of two bases, and studied in ||9l, ll30l in a general 
setting. 

Lemma 4. (^26l/) Null space condition for low-rank re- 
covery Let A : R"i^"2 jjm ^ linear measurement 
operator Assume e = then one can recover all matrices 
Xq with rank(Xo) < k via program\2\if and only if for any 
W e AfiA) we have 

k rii 

< ^ a,{W). (11) 

1=1 i=fe+l 



IV. Main Result 

In this section, we state our main result which enables us 
to seamlessly translate results for vector recovery to matrix 
recovery. Our main theorem assumes that operator A satisfies 
an extension property, defined below. 

Definition: Extension. Let P be a property defined for 
matrices, A G M™^". We say that a linear operator, A : 
]]jnixri2 _^ jjm extension property, P*^ if all its 

restrictions Ajj^v have property P. 

RIP and SSP are two examples of property P that are of 
interest in this paper We show later that the main theorem can 
be applied to these properties. 

Let 11 • \\y be an arbitrary norm on R" with ||x||i, = ||x|j„ 
for all X. Let \\ ■ \\m be the corresponding unitarily invariant 
matrix norm on R"iX"2 ^u^h that ||X||,„ = For the 

sake of clarity, we use the following shorthand notation in the 
main theorem for statements regarding recovery of vectors: 

« Vi: A matrix A : M" — > K™ satisfies a property P. 

• ¥2'- In program [T] for any xq, ||z||2 < £, y — Axq + z 
and any x* as good as xq we have, 

||x* -xoll-t, < /i(xo,e). (12) 

for some h. 

• V3: For any w G Mi^A), w satisfies a property Q. 

We also use the following shorthand for statements regarding 
recovery of matrices: 

. Ml. A linear operator A : M"i><"2 ^ jgm satisfies the 
extension property P^. 

• M2: In program|2] for any Xq, ||z||2 < e, y = A{Xo)+z 
and any X* as good as Xq we have, 

\\X* -Xa\U<h{^{Xo),e). (13) 

. M3: For any W G JV{A), Y.{W) satisfies property Q. 

Theorem 1. (Main Theorem) 

For a given P, the following implications hold true: 

{Vi V2) ^ {Ml =^ M2) (14) 

{Vi =^ Fa) =^ (Ml =^ Ah) (15) 

Proof: {Vi =^ V2) => (Ml => M2). 
Assume Vi =^ V2 and that Mi holds. Consider program |2] 
where measurements are yo — A{Xq) + zq with ||zo||2 < £• 
We would like to show that for any X* that is as good as 
Xq w.r.t yo, it holds that \\X* - Xq\\^ < /i(E(Xo),e). 
Consider any such X* and let W ~ X* — Xq. This implies 
that \\Xo + W\\. < \\Xo\U and \\A{Xo + W) - yoh < £• 
Then, from Lemma |2] for Xi ~ —UT^XaV^ (where W has 
SVD U^wV^) we have \\Xi + W\U < ||^i|U- Now, let 
yi = A{Xi) + Zq. Clearly 

\\A{Xi + W)-yi\\2 = \\AiXo + W)-yo\\2<e (16) 

and hence Xi +W is as good as Xi w.rt yi . Now consider 
program 1 with Ajjy as measurement matrix, yi as measure- 
ments, xi = — as unknown vector and w = Siy as the 



perturbation. Notice that Xi+w is as good as xi w.r.t yi. Also 
since A has P*^, Ajjy has P and thus Vi holds for A — Ajjy. 
Using Vi =^ V2 we conclude 

\\W\\rr. = ||w||„ < /i(xi,e) = /j(S(Xo),e) (17) 

It thus holds that Mi =4> M2- 

Using similar arguments, we now show that (Vi =^ 

V3) =^ {Ah =^ Ms). 

Assume Vi =^ V3 and that Mi holds. Consider any 
W e Af{A) with SVD ofW^ UT,wV^. Then, A{W) = 
AuyY.{W) = 0. Also A^/.y satisfies P and hence Vi holds 
for A = Auy. Using Vi =4> V3, we find T,{W) satisfies Q. 
Hence Mi => M3. ■ 
As can be seen from the Main Theorem, throughout the 
paper, we are dealing with a strong notion of recovery. By 
strong we mean P guarantees recovery for all Xq (Xq) with 
sparsity (rank) at most k instead of for just a particular Xq 
(Xq). For example, results for the matrix completion problem 
in the literature don't have a strong recovery guarantee. On the 
other hand it is known that (good) RIP or SSP conditions guar- 
antee recoverability for all vectors and yield strong recovery 
results. 

In the next section, we show that the main theorem can be 
applied to RIP and SSP based recovery and thus the corre- 
sponding recovery results for matrix recovery easily follow. 

A. Application of Main Theorem to RIP based recovery 

We say that f{Si-^ , ■ ■ ■ , Si^ , Oj^ji^ , ■ ■ ■ , Oj^j'^) < c is an RIP 
inequality where c > is a constant and /(•) is an increasing 
function of its parameters (RIC and ROC) and /(O, . . . , 0) 
0. Let be a set of RIP inequalities namely fi, . . . , where 
/c'th inequality is of the form: 

Lemma 5. If A : ]R"i>*"2 _^ j^m satisfies a set of (matrix) 
RIP and ROC inequalities T, then for all unitary pairs {U, V), 
Ajjy will satisfy the same inequalities. 

Proof: Let 5'k,0'f,,,, denote RIC and ROC of of Auy 
and 6k,dk,k' denote RIC and ROC of A{-). Then we claim: 

S'k < and 9'^. ^, < 9k,k'- For any x of ||x||o < fc, let X = 
[/diag(x)F^. lising ||x|l2 = \\X\\f and Auyx = AiX) we 
have: 

(1 - Sk)Ml < \\A{X)\\l = WAuyi^Wl < (1 + ^.)||x||2 

Hence S'f, < 5k. Similarly let x, x' have disjoint supports 
with sparsity at most fc, k' respectively. Then obviously X = 
[/diag(x)V""^ and X' — f7diag(x')V^^ satisfies the condition 
in ROC definition. Hence: 

\{Auy^,Auy^)\^\{A{X),A{X'))\ 

<6k,k'\\x\\F\\x'\\F = ekM\A2\Wh 

Hence 9'f. f., < 9k.k' ■ Thus, Auy satisfies the set of inequal- 
ities F as fi{-ys are increasing function of Jfc's and 9k.k''&- 



We can thus combine Lemma |5] and the main theorem to 
smoothly translate any implication of RIP for vector recovery 
to corresponding implication for matrix recovery. In particular, 
some typical RIP imphcations are as follows. 

RIP implications for fc-sparse recovery, Suppose A : 
K" — > K™ satisfies, a set of RIP inequalities J-. Then for all 
Xq. ||z||2 < e cind x* as good as xq we have the following li 
and li robustness results, 

||xo-x*||2 < -^llxo-xSlli + Cse (19) 

||xo-x*||i < Csllxo-xglii (20) 

for some constants Ci, C2, C3 > 0. 

Now, using Lemma|5]and Theorem[T] we have the following 
implications for matrix recovery. 

Lemma 6. Suppose A : M"i^"2 _^ j^m g^^fisfies the same 
inequalities T as in \20\ . Then for all Xq, ||z||2 < e and X* 
as good as we have the following Frobenius norm and 
nuclear norm robustness results, 

\\Xo-X*\\F<^\\XQ-X^\U + C2e (21) 

11^0 < Calico -^olU (22) 

B. Application of Main theorem to SSP based recovery 

Lemma 7. Let A > 0. //yl : R"!^"^ ^- R" satisfies A-SSP 
then for all unitary pairs (U,V), Ajjy satisfies A-SSP. 

Proof: Consider any w e J\f{Au.v)- Then, 
A{U diag{-w)V'^) = and therefore W 
[/diag(w)F'^ e J\f{A). Since A satisfies A-SSP, we 
have ^jj = > ^/^. Thus Auy satisfies A-SSR ■ 

Now we give the following SSP based result for matrices 
as an application of main theorem. 

Theorem 2. Consider program\2\with z — 0, y — A{Xq). 
Let X* be as good as Xq. Then if A satisfies A-SSP with 
A > 4fc, it holds that 

\\X* - Xo\U < C\\Xo - X^\U (23) 
where C ~ ^, 

l-2y'k/A 

Note that the use of main theorem and Key Lemma simplifies 
the recovery analysis in (12] and also improves the sufficient 
condition of fc < in 1 12 | to fc < ^. This improved sufficient 
condition matches the sufficient condition given in ||30l for the 
sparse vector recovery problem. 

V. Simplified Robustness Conditions 

We show that various robustness conditions are equivalent 
to simple conditions on the measurement operator The case 
of noiseless and perfectly sparse signals, is already given in 
Lemmas [3] and HI Such simple conditions might be useful for 
analysis of nuclear norm minimization in later works. We state 
the conditions for matrices only; however, vector and matrix 
conditions will be identical (similar to Lemmas |3] IHl as one 



can expect from Theorem [T] The proofs follow from simple 
algebraic manipulations with the help of Lemma [T] 

Lemma 8. (Nuclear Norm Robustness for Matrices) 

Assut7ie e ^ (no noise). Let C > 1 be constant. Then for 
any Xq and any X* as good as Xq we are guaranteed to 
have: 

\\Xo-X*\\,<2C\\Xo-X^\U (24) 
if and only if for all W € M{A) we have: 



C-1. 



C + 1 

Lemma 9. (Frobenius Norm Robustness for Matrices) 

Let e = 0. Then for any Xq and X* as good as Xq, 



(25) 



C 



if and only if for all W € Af{A), 



\W-W''\U-\\W''\\,>'^\\W\\p 



(26) 



(27) 



Lemma 10. (Matrix Noise Robustness) For any Xq with 

^(^o) !i k, any ||z||2 < e and any X* as good as Xq, 



\Xn-X* 



< Ce, 



(28) 



(29) 



if and only if for any W with \\W''\\^ > \\W - W'' 

\\W\\F<^\\A{W)h 
VI. Null space based recovery result for 

SCHATTEN-p QUASI-NORM MINIMIZATION 

In the previous sections, we stated the main theorem and 
considered its applications on RIP and SSP based conditions 
to show that results for recovery of sparse vectors can be 
analogously extended to recovery of low-rank matrices without 
making the recovery conditions stronger In this section, we 
consider extending results from vectors to matrices using an 
algorithm different from ii minimization or nuclear norm 
minimization. 

The £p quasi-norm (with < p < 1) is given by 
ll^^llp — ^ote that for p = 0, this is nothing 

but the cardinality function. Thus it is natural to consider 
the minimization of the £p quasi-norm (as a surrogate for 
minimizing the cardinality function). Indeed, £p minimization 
has been a starting point for algorithms including Iterative 
Reweighted Least Squares [10| and Iterative Reweighted £i 
minimization lITSl . (|6l. Note that although £i minimization 
is convex, £p minimization with < p < 1 is non-convex. 
However empirically, £p minimization based algorithms with 
< p < 1 have a better recovery performance as compared 
to £i minimization (see e.g. |'8l,fl5|). The recovery analysis 
of these algorithms has mostly been based on RIP. However 
Null space based recovery conditions analogous to those for 
£i minimization have been given for £p minimization (see e.g. 

nm, ii29i). 

Let Tt\A\p = Tr(A'^A)i = ELi^l^) denote the 
Schatten-p quasi norm with < p < 1. Analogous to the 



vector case, one can consider the minimization of the Schatten- 
p quasi-norm for the recovery of low-rank matrices. 



minimize Tr|X|P 
subject to A{X) — y 



(30) 



where y = A{Xo) with Xq being the low -rank solution we 
wish to recover IRLS-p has been proposed as an algorithm 
to find a local minimum to (l30l l in [22|. However no null- 
space based recovery condition has been given for the recovery 
analysis of Schatten-p quasi norm minimization. We give such 
a condition below, after mentioning a few useful inequalities. 

Lemma 11 ([128]). For any two matrices A,Be R™^" it 
holds that Eti(^f (^) - (5)) < Eti - B) for all 
k — 1,2, . . . ,n. 

Note that the p quasi-norm of a vector satisfies the triangle 
inequality (x,y G R", J:7=l\^^ + J^d" < Etil^^l" + 
lUil^y Lemma [TTI generalizes this result to matrices. 

Lemma 12 (|19|). For any two matrices A, B it holds that 

at+,-i{A + B)<atiA)+a,{B) (31) 

where t + s — 1 < n,t, s > 0. 

The following lemma easily follows as a consequence. 

Lemma 13. For any two matrices. A, B with B of rank k and 
any p > 0, 

n—k n 

E af{A~B)> af{A). 



i=k+l 



i=2fc+l 



Theorem 3. Let rank(Xo) = k and let X denote the global 
minimizer of \30h A sufficient condition for X — Xq is that 
Y.f=,<{W) < J:t2k+i^!m for all W^e N{A). A 
necessary condition for X = Xq is that X] =i'''f(^) — 
Htk+i'^^mfor allW^N{A). 

Proof: (^) For any W G M{A)\{Q}, 



TrlX 







Y^a^{XQ + W)+ J2 '^!iXo + W) 



> 



E 



{af{XQ)^af{W)) + 



E 

i=2k+l 



afiW) 



>Tt\Xq\p 



(32) 



where the first inequality follows from Lemma [TT] and Lemma 
[T3] The necessary condition is easy to show analgous to the 
results for nuclear norm minimization. ■ 
Note that there is a gap between the necessary and sufficient 
conditions. We observe through numerical experiments that a 

n n 

better inequality such as ^ af{A-B) > ^ \af{A)-af{B)\ 

1=1 1=1 
seems to hold for any two matrices A, B. Note that this is 

in particular true for p = 1 (Lemma [T]i and p = 0. If this 

inequality is proven true for all < p < 1, then we could 



bridge the gap between necessity and sufficiency in Theorem 
[3] Thus we have that singular value inequalities including 
those in Lemma [T] and Lemma [T3] [TT] play a fundamental 
role in extending recovery results from vectors to matrices. 
Although, our condition is not tight, we can still use the 
Theorems [U and [3] to conclude the following: 

Lemma 14. Assume property S on matrices E" M™ 
implies perfect recovery of all vectors with sparsity at most 
2k via £p quasi-norm minimization where < p < 1. Then 
implies perfect recovery of all matrices with rank at most 
k via Schatten-p quasi-norm minimization. 

Proof Idea: Since S implies perfect recovery of all vectors 
with sparsity at most 2k, it necessarily implies a null space 
property (call it Q) similar to the one given in Lemma [3] (fTOl l 
but with p in the exponent (see e.g. [29 1) and k replaced by 
2k. Now the main theorem, (fTSl l. combined with Theorem |3] 
implies that S*^ is sufficient for perfect revovery of rank k 
matrices. 

In particular, using Lemma [14] we can conclude, any set 
of RIP conditions that are sufficient for recovery of vectors 
of sparsity up to 2k via tp minimization, are also sufficient 
for recovery of matrices of rank up to k via Schatten-p 
minimization. As an immediate consequence it follows that 
the results in Q, ifTSl can be easily extended. 

VII. Conclusions 

We presented a general result stating that the extension of 
any sufficient condition for the recovery of sparse vectors 
using ti minimization is also sufficient for the recovery of low- 
rank matrices using nuclear norm minimization. Consequently, 
we have that the best known RIP-based recovery conditions 
of 5k < 0.307 (and 62k < 0.472) for sparse vector recovery 
are also sufficient for low-rank matrix recovery. Note that our 
result shows there is no "gap" between the recovery conditions 
for vectors and matrices, and we do not lose a factor of 2 in the 
rank of matrices that can be recovered, as might be suggested 
by existing analysis (e.g. ll27l ). 

We showed that a Null-space based sufficient condition 
(Spherical Section Property) given in |30| easily extends to 
the matrix case, tightening the existing conditions for low-rank 
matrix recovery [12|. Finally, we gave null-space based condi- 
tions for recovery using Schatten-p quasi-norm minimization 
and showed that RIP based conditions for £p minimization 
extend to the matrix case. We note that all of these results 
rely on the ability to "vectorize" matrices through the use of 
key singular value inequalities including Lemma [T] [TTI 
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